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What would it take to make Shigi a reality? 



Virtual Wind Tunnel for Game Design 
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"Evolver" Coevolutionary Optimizer: 

'What, How, and V/HY 
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Shigi 
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Science 

Fiction! 



I'm trying to sell you on a 

way of thinking about design. 


I'm not trying to sell you a took 
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I'm not trying to sell you a tool. 


I'm trying to sell you on a 

way of thinking about design. 
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I'm trying to sell you on a 

way of thinking about design. 


I'm not trying to sell you a took 
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Be 




Giame Design 


"deep tools" 


That understand the designer s 


intent, 


Not just the game s 


content? 








Diai:-j?jt fditinj! Lls’: 


"We are still alchemists of our trade, mixing two parts impure story 
with one part polluted gameplay with three parts market voodoo. 



As an industry, we need to move beyond the lystical hand 
wavint that defines modern game design." 

-- Daniel Cook, Spry Fox 




"Our design process is a giant Katmari ball. 



picking up every idea it rolls over." 

- Anonymous producer 



Modern game design = "iteration" 
"Iteration" = trial and error 



Exploring the darkness. 

No disciplined way to explore the possible design decisions 
and their ramifications without actually implementing them. 



An Edisonian Process 



Risky. Expensive. Time-consuming. Error-prone. 

Prototyping is faster & cheaper but STILL very expensive & time- 
consuming. 

We take for granted that this is the ONLY way to design! 


PR 621 
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These are not design tools. 

• Not interactive ^ A 

• Pre-release user testing with focus groups & 
beta testers is expensive -- costs scale linearly 

• Post-release user testing is too 1 ite 




Moore s Law 


Performance / $ 



■ Moore's Law — 
Doubles 18 months 
(number of transistors) 

■ Data Storage — 
Doubles 12 months 
(bits per square inch) 

■ Optical Fiber — 
Doubles 9 months 
(bits per second) 


PR 621 


What could we do with 




What could we do with 


"deep tools" 


That understand the designer's 

intent, 

Not just the game's 

content? 


Lighting 

Dialogue Editing 


Animation 

Particle Effects 

Scripting 

Level Design 

Al Sound Design 



I have a discrete description 
of the current design 


I understand how your game world 
represents space and time 



I have a description of your 
design goals and constraints 


I understand how the agents can he 
created, destroyed, and interact in the 
game world 




I can EXPERIMENT with the 

current design configuration and 
test the outcome ... 



... against your design goals 
and constraints 


I 


I have a discrete description 
of the current design 
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I have a description of your 
design 


goals and constraints 


ot the 



I understand how your 
represents space and time 


game world 
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design goal 


I understand how the agents can be 


created, destroyed, and interact in the 


game world 


I can EXPERIMENT with the 

current design configuration and 
test the outcome ... 


... against your design goals 
and constraints 


The "Photoshop of AI" Debate 


Adobe 

Brainoshop 



"Virtual Wind Tunnel 
for Game Design" 
Debate 
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Design is the 
process of 


for optimal design 
configurations in the 
space of possible 
design decisions 


Artificial intelligence 
is the study & 
implementation of 





to make decisions 
more quickly and 
more optimally than 
humans can do alone. 


Design is search. 


The process of design is a sequence of decisions 
through the search space of design possibilities. 
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Jumping puzzles 

(y/n)? 



Separate ammunition 
types or 
"universal 
ammo" system? 





What player 
character 
classes? 



Tank unit: 
change health / 
damage / speed 




Design is search. 


The process of design is a sequence of decisions 
through the search space of design possibilities. 
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l 


Howitzer 



Cavalry 



+1 damage 



-1 damage 



give 

unicorn 

spell 


Possibility 

space 
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:e! 

its 

-play. 


NE 
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Design Space 



• In theo 
autom 
could a 
and ho 


• Challen 
design 


• Challen 
quantif 
game c 




rs \ 



Design Space 



In theory, you could search this tree to 
automatically (re)design a game if you 
could accurately determine how to branch 
and how to evaluate each branch. 


Challenge #1: how to enumerate the possible 
design changes 


Challenge #2: how to characterize and 
quantify the possibility space of the resulting 
game configuration 


Maybe Not Quite as Hard 
as it Looks ... 


No need to fully explore each possibility space! 

We only care about how it is different from its 
parent -- how (or whether) it alters the gameplay. 


Don't necessarily need to narrow down to ONE 
optimal configuration Search itself can be useful 
if it reduces the scope of the problem to 
something designers can solve manually. 
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Design Space 




What would it take to make Shigi a reality? 
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Siri's natural language, text to speech 
& conversational capabilities 









Siri's natural-language, text-to-speech 
Sr conversational capabilities 



A representation of the game and 
the ability to reason about it 
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A deep knowledge base of gameplay rules, 
concepts, Sr mechanics 



All of Miyamoto -san's design wisdom and experience added 
to the knowledge base, along with his bizarre princess fetish 



The ability to run millions of simulations of different 
variations of the design and characterize the results 





The ability to perform interactive data 
mining on the output of those simulations 





quietly making progress 



Academic Research 
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An Interactive Game-Design Assistant 


Mark J. Nelson 

College of Computing 
Georgia Institute of Technology 
mnelsim @ cc . gatech , ed u 


ABSTRACT 

Game-design iu^>l\% inerting Ly hope to use game-like ex- 
press km as a way to express content such as opinions and 
cduc ational nuuriiL Exiting game^fcsign toolkit* such as 
Game Makrt ease the progiamming burden, twinging the 
design of small games hi ihi ii the technical reach of Um- 
budgee ooo*expert groups. The design process itself re* 
naiw a inadhlivk. however; li is not at all obvious how to 
present topics such m political viewpoints or hike safety in 
a w ay that mako use of the unique qualities of the interac- 
tive game medium. There arc no loots to assist in that aspect 
of the game design process, and as a result virtually all ex- 
pressive games come from a small number of game studios 
founded by experts in designing such games. We propose a 
game-design assistant that acts in a mixed-initiative fashion. 


Michael Mateas 
Computer Science Department 
University of California Santa Cruz 
nucnacl m @ soe jftcac.edu 


Flash, that greatly ease the programming burden for creating 
simple games. 

Rather, the mam roadblock is the game design process it* 
self, the process of presenting desiied content, such as hike 
safety, the policy implications of a proposed law, or high 
school algehia, in a way that makes use of the unique quali- 
ties of tile game medium. These unique qualities include ere* 
aline a strong sense of player agency* procedural! y express- 
ing the possihlc^worlds implications of player decisions, and 
enabling players to experiential ly explore rule systems* 1 Ex- 
isting game toolkits such as Came Maker or Atke* prov ide 
no help with the design problem of mapping content into a 
system of game rules, hut rather facilitate the programming 
task of implementing die game rules once design is already 


Avoider"] 


[ AtUckeil 


ConceptlMet Capable Of 


Word Net: hyponvin 


ConceptNet; CapableOfRecervingAnion 

X 


"animate thing" 



WordNet: hyponym 

X 


I "projectile” | 


ConceptNet: CapableOf Receiving Aaion 
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Computational Intelligence and Tower Defence Games 


Phillips AvCf}' 

Department of Computer Science and Hngineenng 
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Email: pippa^csc unr-cdu 


Julian Togdius. Elvis AUstar. 
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Abxlmrt— Hie aim of this paper W le introdiHT the um j wf 
Timer Udnet (TUl conn in (anpiitatiiiiULl I nielli gt 1 me (Cll 
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possibilities to improve the gamepby of TD games using Cl 
methods. 

TD games can be naklUK or m nature. and the 



Pig, 4 The Infinite TD game during play of another level, in the middle of 
a creep wave. The purple stars inside the dark path arc creeps, moving from 
the dark green path entrance towards the red path exit. Above each criller 
is a small green bar signifying its current health. The brightly coloured 
pentagons outside of the path are lowers. One of the towers is currently 
selected, meaning thal a dimly illuminated circle around the tower shows 
its range, and the info box lo the right or the screen displays ils statistics 
(range, speed, splash range etc). 


Evolution points during 28 generations 



Population Si* 10 

Population Size 3d 
Population Size SO 
Pop ulation Sire 70 


14 7 10 IS It 19 12 15 JS 


Fig. 5. Creep evolution. The 'evolution points” value refers to the number 
of points that need to be spent before attaining a fitness of at least I , meaning 
that at least one creep breaks through the player's defences and reaches the 
end of the path. In this game, the creeps are tested against a complicated 
map with 30 towers. 
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Tanagra: Reactive Planning and Constraint Solving 
for Mixed-Initiative Level Design 

Gillian Smith, Student Member, IEEE, Jim Whitehead Senior Member, IEEE, and Michael Mateas 


tfatfrrtrl— Ikupi b * timed-iiij lift the laol fur Irvd dni^n. al- 
lowing a hutiun md a cuinpulcr la work tttgftlw-r to produtc J 
level fora 2*D pl*i1 former. An underl? lag, mdi>f Ind |»entor 
flinm Ifaal al In rls created in ihe rnv iron me nt are pta\ able, and 
provide* the atnlitv tor a human dnisner tn rapklK view manv dif* 
irrrni level* thai meet their tpreihe niton*, The Huitun designer can 
keraliv d> refine the level In pL*ciii|: and mo * inf level geouietrv, W 
well at lb rough dircelK manipulating the pacing of the level. This. 


a procedural corn cut generator, capita I i/es on tlk- strengths of 
both hunt an arid computer designers, Tanagra % undet lying level 
generator is capable of producing many different variations on 
a level more rapidly iban human designers, whose strengths in- 
stead lie in creativity and the ability to judge the quality of the 
generated content- The genet aior is able to guarantee that all the 
levels n creates ate p lav able, thus re focus mu earlv plav testing 



Evaluating Competitive Game Balance with Restricted Play 


Alexander jaJTe, Alex Miller, Erik Andersen 
Yui!* *Eu Liu, Anna Karlin, Znran Popov ic 

Department ol C ixnpuicr Science £ ling meet mg 
U nivemty of Washington 

{ aiafTe.anii]lcr + eland.yiinliti.karlLn./oran wasdiingtoiredu 


Abstract 

Game balancing it the hnotuntivr phj*c m which j function* 
ing game is adjusted In be deep, fair, and intcitsling. Balanc- 
ing is difficult ami tjibr<u«t)iiminf. as ileskgwrs must repeal* 
edlv tweak parameters, and run lengthy playlcvt* to evaluate 
the effects nf these changes. If designers could receive im- 
nidiJk feedback on then designs, ihn 1 could explore a vast 


and designer intuition, while producing inherently fuzzy an- 

nm, 

A rut trial question i> whether Mime portion of competitive 
game balance evaluation could be automated. through Al 
unuaktion by a backend reasoning tool I Nelson ajvd Mateus 
2009 f rather than phyiesiing. One major roadblock to this 
goal is that the standard approach to evaluating balance re- 


Cards 

Analyst Cjrr* me jda Reports 


l/l | I i [mm* | 


l/2 | n i | fttfate | 

"l/6 ' | ■ i | Mm j 

1 +*dd 

Computed Games 

• fll/I.GIffl.BIfl.'ZM 

■ HZfl.Gafl.BAfl.irlja. 

* HZB.Gafl.B4B. 
a R1/l,G1ffl,BlJ6. 

Overview Visualization 


Balance Measures 

Current Game: R1/1,G1/2,B1/G. 

Player 1 (50*| 

Aggressive (*3% wins. O.OBW *M,J 
Lew-Randomness (a&.TZl&S 
Greedy (2241WJ 
Random (£241 TV) 

OmitRi/1 

Omit BV6 £11.E4%| 

Omit G 1 /Z [ 1 1 , 54 %] 

No-Randomness (0%) 

Prefer R! / 1 (&%) 
prefer 61/6 (0%J 
Prefer GUZ p%) 


Fig, 1 : A basic analysis using our tool. The results show the 
performance of varieties of restricted play against a 
restriction-exploiting player. Players who never play 
Red 1/1, for example, win 1 1 .54% of the time. 



Fig. 2: Monsters Divided, G\/\ and #5/6 are played, with 
+3/2 and +1/3 power cards applied to them, re- 
spectively. G’s rule is in play: closest to 1/2 wins. 
5/6 + 1 /3 beats 1/1 + 3/2, so P2 wins a B trophy. 
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Evolutionary Game Design 


C ameron Browne and Frcdcnc Mai re 
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Pell [ 1 ] suits u 

Ef we aiuki do c kjp a profrsn which. uficn cocindcnitwci 
of a particular game, declared the game to be 
uninicraifitig. this would uem to be a true sign of 

isue, we will 


Yavalath 


Imdex Term * * 
Kithrtki. |«nc c 


W miL g,r 
artificial i 
few decades, Uil 
classics Midt as 
yardstick fo f sue 

In*." 1* 


0-15 

ft! 


corr = -0.6491 


a to 
Ranking 
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Fig. I L. Predicted score versus pllayer ranking of synthesised games. 



Fig. 12, Yavalath puzzle: White Lo play and force a win, 
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Tower Defense Map Balancing 



5TRONGPQINT TOLUER DEFENSE 





1Q0 

30 

60 

40 

20 

0 


□ V 



■ Gun Turret 


■ Lightning 
Tower 

■ Ground 
Slammer 

■ Rocket 
Launcher 


■ Flamethrower 


■ Grenade 
Tosser 


Airflow of Virtual Wind Tunnel 



AI- Assisted Reconfiguration 
of a Game 'World 



configurations 


2 configurations 


3fe,il3 eemfigurMisns 






^constraints! 



I'm trying to sell you on a 

way of thinking about design. 


I'm not trying to sell you a took 
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^anae Design 


Baby Steps 


CITY CONQUEST 
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Design goals 

• No globally dominant strategies 

• Every tower/unit has a unique tactical role 

• Every tower/unit's resource cost (gold or crystals) 
is proportional to its average utility 

• Every tower/unit is useful when considering its 
unique role and its cost 

(... + many more not listed here) 
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Bui ld= 0,11,46, M in e,8 
Build=0,11,48,Mine,l6 
Build=0,ll,47,Skyc,24 
Build=0,14,42,Turr,28 
Build=0,14,40,Turr,171l84 
Build=0,9,47,Mine,52 
Build=0,9,49,Mine,60 
Build=0,15,45,CrSl,100808 
Build=0, 10, 49, Drop, 100812 
B ui 1 d= 0,1 3,45, Rkt L,1 00816 
Build=0,17,44,RktL, 100820 
Bui I d= 0,1 0,45,Skyc,l 00824 
U pgrade= 0,13,45, RktL,l 0 08l 6 
Build=0, 17,49, Drop, 100832 



Build=0,ll,46,Mine,8 
Build=0,ll,48,Mine,l6 
Build=0,ll,47,Skyc,24 
Build=0,l4,42,Turr,28 
Build=0, 14, 40, Turr, 171184 
Build=0,9,47,Mine,52 
Build=0,9,49,Mine,60 
Build=0,15,45,GrSl,100808 
Build=0, 10, 49,Drop, 100812 
Build=0, 13, 45, RktL, 100816 
B ui I d= 0,1 7,44, Rkt L,1 0 0 82 0 
Build=0,10,45,Skyc,100824 
Upgrade=0, 13, 45, RktL, 100816 
B ui I d= 0,1 7,49, D rop,1 0 0 83 2 


Build=l,ll,46,Mine,8 
Build=1,11,48,Mine,l6 
Build=1,11,47,Skyc,24 
Build=1,14,42,Turr,28 
Build=1,15, 45, GrSl, 100808 
Build=1,14, 40, Turr, 171184 
Build=1,9,47,Mine,52 
Build=1,9,49,Mine,6o 
Build=1,12, 44, RktL, 100836 
Build=1,10,49, Drop, 100812 
Build=1,13, 45, RktL, 100816 
Build=1,17,44,RktL,100820 
Build=1,1 0,45,Skyc,1 00824 
Upgrade=1,17,44,RktL,100820 


Mutation 

Crossover 

Replacement 
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Iteration 2 



Mutation 

Crossover 

Replacement 
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• Manual re-balancing 

• Excel Solver optimization 

Aesthetic aspects of balancing are 
difficult/impossible to quantify 


Fitness Function 


Player A's Capitol's health 


Ptayer B's Capitol's health 


Fitness Function 
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Player A's Capitol's health 


Player B’s Capitol's health 



Evolver 


• Skip rendering 

• Optimize game logic 

• Parallelize with Intel Threading Building Blocks 

• Fitness function customizations 

• Island genetic model 


-1 million simulated games in 12-14 hours 
(running overnight on a spare PC) 




Evolver 


* Skip rendering 

* Optimize game logic 

* Parallelize with Intel Threading Building Blocks 

* Fitness function customizations 

* Island genetic model 


Positive ROI 

• Total 2 weeks of coding & tuning effort 

• Replaced 3-5 weeks of hand-tuning! 

• Better results! 

• Allowed incremental exploration of design decisions 




~1 million simulated games in 12-14 hours 
(running overnight on a spare PC) 


021 



Evolver 


• Skip rendering 

- Optimize game logic 

• Parallelize with Intel Threading Building Blocks 

* Fitness function customizations 

* Island genetic model 



-I million simulated games in 12-14 hours 
{running overnight on a spare PC) 


Positive ROI 

• Total 2 weeks of coding & tuning effort 

• Replaced 3-5 weeks of hand-tuning! 

• Better results! 

• Allowed incremental exploration of design decisions 

Optimized for Victory 


Computer Player Al 

* Traditional Al system 

* Behavior tree 

* Script-guided building placement hints 

* Behavioral mathematics 


Behavioral Mathematics 


or Game Al 



™ i }j | Dave Mark 


Optimized for Player 
Entertainment (Fun!) 




Goals 

• GA for mission tuning & balancing 

• Fitness function customizable for each mission 

• GA-based Al vs computer player Al 

• Integrate with external data mining system to 
get more useful data from results 
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I'm not trying to sell you a tool. 


I'm trying to sell you on a 

way of thinking about design. 
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Virtual V/ind Tunnel for Game Design 
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